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Abstract. This work introduces the notion of edge oriented reinforced 
random walk which proposes in a general framework an alternative un- 
derstanding of the annealed law of random walks in random environ- 
ment. 



1. Introduction 

The aim of this text is to present in a general framework a precise and 
explicit correspondance between a class of edge oriented reinforced random 
walks and random walks in random environment (RWRE). In other words 
the study of an edge oriented reinforced random walks, which is strongly 
non-Markovian, is equivalent by introducing an external randomness, to a 
Markovian problem. This relation already appeared, as a tool, in a work of 
Pemantle (cf ||), for the study of reinforced random walks on binary trees, 
for very special laws of reinforcement. 

The essence of the result is that the law of an edge oriented reinforced 
random walk coincides with the annealed laws of a RWRE if the law of 
reinforcement satisfies the following condition: at one point the probability 
of a sequence of successive moves depends only on the number of each type 
of move. This condition, we call admissiblity, is expressed as the closedness 
of a certain discrete form. The proof of our result is based on a theorem 
on the moment problem for random variables in [0, l] d . As a corrolary, the 
uniqueness of this moment problem implies that the annealed law determines 
the quenched law for RWRE. 

2. Definitions and statement of the result 

Definition 1. We call law of reinforcement with d neighbours a function 
V: 

d 

V : T d := ...,x d ) 6]0, l] d , s.t, J2 x i = !} 

i=l 

P= (Pi,-,Pd) -> (Vi(p), V d {p)) 

We now define for a law of reinforcement the notion of admissibility, which 
will play a key role in the following. Let (ej)i<j<d denote the canonical basis 
of Z d + . 

l 
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Definition 2. Let us consider the graph whose edges (p,p + ei) are ori- 
ented from p to p + ej . Let V be a law of reinforcement on and w be the 
1-form defined by w((p,p + ej)) = lnVi(p). 

We shall say that V is admissible when w is a closed form. 

We consider now a countable graph G having at any point a finite number 
of neighbours. For any vertex x of G we denote by d(x) the cardinal of the 
neighbours of x and {e(x, = l,...,d(x)} the neighbours of x. At any 
vertex we suppose given a law of reinforcement V{x) with d(x) neighbours: 
V(x) : p -> {Viix^p))^^). 

Definition 3. We call reinforced random walk with law of reinforcement 
V{x), the random walk defined by the family of laws on the trajectories 
starting at x , (P Xo ) XqIeG given by 

P X0 (X n+1 = e(x,i)\a(X n =x) Aa(X k ,k < n - 1)) =Vi(x,N(x)) 
where N(x) = (JV.CaOJl^dfc) and Ni(x) = l{x l= x,x t+1 =e(x,i)}- 

Definition 4. A reinforced random walk is called admissible when V{x) is 
admissible for all vertex x of G. 

Let us now introduce random walks in random environment on the graph 

G. 

We define an environment as an element oj = (u(x)) x eG where at any 
vertex x, lo(x) is in Tm x \. At any vertex x of G, we consider a probability 
measure fj, x on T d r x \ and we set [i := ® fx x , so that fj, is a probability 

measure on the environments such that (uj(x)) x ^g are independent random 
variables of law \jl x . 

We denote by P Xo ,u the law of the Markov chain in the environment uj 
starting at xq defined by: 

Vxo € G, yk G N, P XOtLU (X k+ i = e(x,i)\X k = x) = oj(x,i). 

Finally we denote by P x the annealed measure i.e. P x = [i ® P X)U >- We are 
now able to state our main result: 

Theorem 1. For any countable graph G 

i ) For all law of environment fj, = ® u x the law of the reinforced random 

walk (P Xo ) Xoe G associated with the law of reinforcement V given by: 

(1 Vi {x,pi,...,p d{x) = , — 

(where E^ x denotes the expectation under the law fi x ) coincides with the an- 
nealed law of the RWRE (P xo ) xo ^g- Moreover the law (V(x)) is admissible. 

ii) Conversely, if V is an admissible law of reinforcement on G, then 
there exists a unique law of environment [i = ® \i x for which equality ([Jj is 
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satisfied, thus for which the law of the reinforcement random walk (P Xq ) Xo ^g 
coincides with the annealed law (P xo ) xo eG- 

Corollary 1. The annealed law determines the quenched law for RWRE, 
i.e. there can not exist two different laws of environment fi and // with the 
same annealed law (P Xq ) Xo ^g- 

Example 1: At any point x, choose a vector (a(x,l), ...,a(x,d(x)) in 
(Ml)^ 21 ). The law of reinforcement Vi(x,pi, ■■■,Pd( x )) = — d^f'^^' — is an 

Ej=o ;a{x,j)+ Pj 

admissible law of reinforcement associated with the environment (n x ) X £G 
where fi x is a Dirichlet law with parameters (a(x, 1), ...,a(x,d(x))), i.e. fi x 
is the law on T d ^ with density 

/. , s T(a(x, 1) + ... + a{x, d(x)) yj a {x,i)-i 

This is the meaning of the classical Polya's urn scheme (cf section VI. 12), 
if we put at all sites an independent urn which will define the move at that 
site. 

Example 2: We can generalize the previous example as follows: at all point 
x in G, choose not only a vector (a(x, 1), ...,a(x,d(x)) 6 (R^.) 6 ^, but also 
an integer n(x) and a homogeneous polynomial P(x,ti, . . . ,t d r x \) of degree 
n(x) of the form: 

P{x,h,... ,t d[x) ) = a ku ... Mx) (x)t k 1 1 

)• 

where the a klj ... ,k d(x) {x)'s are non-negative reals (not all null). Then we 
define fi x as the law on T d ^ with density 

YtSt?^- l )p{xM,...M*)) 



k M (n^r^j p(x, tl ,...,t d{x) ) 



=1 h 

On the other side, consider the polynomials 

d(x) 

Q{x;y u . . . ,y d{x) ) = ^ a ku .^ kd(x) (x) h), 

fc l— • ' k d(x)- »=1 
*lH ^ k d(x) =n ( x '> 

where we write (y, k) for the product y ■ ■ ■ {y + k — 1). Then the law (fi x ) is 
associated with the law of reinforcement V(x), where Vi(x,pi, . . . ,p d r x )) is 
given by (to simplify, we forget the x dependance in the next formula, and 
simply write for a(x,i) and n for n{x)) 

( oii+pi \ Q{a x +px, . . . ,cti +pi + 1, . . . ,a d + p d ) 



(Y?j=i a i +Pj) + n J Q( ai - >«^+: 



1 



N. ENRIQUEZ AND C. SABOT 



Proof: 

i) For any vertices xq,x of G, VI < i < d(x),\/n G N, 

Px (X n +i = e(x,i)\(X n =x) A cr(X k ,k < n - 1)) 

where Nj(y) is as denned in definition 3. Now using the independance of 
the variables u(y,i) for different vertices y, the terms depending on uj(y,j) 
for y ^ x cancel in the previous ratio and we get i). 

ii) The only point is to prove that for any admissible law of reinforcement 
V with d neigbours there exists a probability measure [i on T^, such that a 
Td- valued random variable X := {X\, ...,Xd) of law fx satisfies V(pi, ...,pd) = 
E[x<nU x ?} 

We can see that the condition is expressed in terms of the moments of 

therefore the aim is to prove that the assumption of admissibility on V 
implies the solvability of the moment problem for fj,. 

For that purpose we introduce the quantities which are intended to be 
the moments of /U. 

Consider s G {1, d} N and the path U(s, .) on defined by: 

U(s,n) := J27=o e s(t) 

and let M(s,n) := U^o V s(i) (U(s,i)). 

The fact that V is admissible implies that M(s, n) depends only on 
U(s,n), indeed M(s,n) = exp( Jq^'^ w) (with the notations of definition 
2). So let us introduce the sequence with d indices: 

Vk ly ...,k d ■= M(s, n) for U(s, n) = k\e\ + ... + k d e d 

What remains to prove is that v is the sequence of moments of a Tm x \- 
valued variable. For that purpose we use the generalization of the Hausdorff 
criterium, concerning the existence of a (unique) solution to the moment 
problem for random variables on [0, l] d . For any h = hi, . . . , h d we define 

the operator A h on real sequences indexed by Z^, i.e. A h : M z + — > M z + and 
defined recursively by 

^{u) = {u %+ei -u % ) %&d+ , 

and 

A fc+e,; = A ei o A fc . 

(Remark that this definition is valid since the A e *'s commute). We re- 
call here the result of Hildebrandt and Schoenberg (cf @): a sequence 
(iijA € [0, l] z + is the moment sequence of a probability measure on [0, 
i.e. Ur = J t^ 1 ■ ■ ■ t^ d d[i(ti, . . . ,td) if and only if for all h and k in Z^_, 
(_l)E^A /l («)(fc) is positive. 
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Let us verify this for the sequence introduced previously. Since for all k, 
Y,i =1 Vi{k) = 1 we have: 

d 

-A e *(v)(k) = ^2v kl ,...,k j +i,...,k d - 

Hence, by composition (—l) hl+ "' +hd A hl, "' ,hd (vk 1) ... ) k d ) wm always be a linear 
combination with positive coefficients of the terms of the sequence v. So the 
condition of the criterium is satisfied. Hence \i exists and is unique as a 
solution of the moment problem whose support is compact. The last thing 
to check is that it is supported by Let X be a random variable with law 
fi. The only thing to check is that Ylf=i = 1 //-almost surely. Since the 
law of J2i=i Xi has compact support this is equivalent to show that all the 
moments of Yli=i are equal to 1. Using the fact that Yli=i = 1 at 
all point k we know that for all integer n 

i = M ( s ' n ) 

se{i,...,d}" 

S #{se{l,... ,d} n , U(s,n) = (k 1 ,... ,k d )}v kl: ..., kd 

fciH Yk A =n 

(fci + --- + fc d )! 

" kl] ... kdl 

fei + ...+fc d =n 

and this last expression is the n-th moment of {X\ + . . . + Xj). 
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